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Abstract. It is shown how the autocorrelation function theory based on 
the Wiener-Khintchine Theorem (WKT) is used to analyze stochastically 
fluctuating phenomena. This theory might be called "time-dependent 
statistical mechanics" since it permits to describe fluctuations that are 
outside the scope of the equilibrium statistical mechanics. It is of prime 
importance in the investigations of noise problems. Are analyzed here the 
Drag and Brownian motion and electric noises. It will be also briefly shown 
how these phenomena can be understood taking into account the 
Fluctuation-Dissipation Theorem (FDT). 
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(I) Introduction. 

According to the Wiener-Khintchin Theorem (WKT) the autocorrelation 
function of a wide-sense-stationary random process has a spectral 
decomposition given by the power spectrum of that process. [1 ' 3] Flere we 
show the main aspects of this autocorrelation function approach [4] which is 
used to analyze stochastically fluctuating phenomena. To do this, let us 
consider a random function of time y(t) of some stochastically fluctuating 
system under observation. In Figure 1 is seen y(t), measured in a time 
interval x, as a function of the time t 



Figure 1 . Stochastic y(t) as function of the time t. 
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Assuming that y(t) can be expanded using a Fourier integral [4] we get: 

y(t)= Jo°° a(f) cos(ft)df + L 00 b(f) sin(ft)df (1.1), 
where a(f) and b(f) are given by 

a(f) = j 0 x I(t) cos(ft) dt and b(f) = JV 0 1(t) sin(ft)dt. 

In the time interval x, during which y(t) is measured, is defined the 

correlation function : [4] 


v|/ y (T) = < y(t) y(t + x) > 


( 1 . 2 ), 


where the average value < ... > is estimated taking into account a large 
number of systems in thermodynamic equilibrium for different instants of 
time t. Here we are assuming the validity of the "ergodic theorem", that is, 
that the time average for a single system in statistical equilibrium may be 
replaced by an average over an equilibrium ensemble. [4] In this sense, t is 
the "ergodic time". Defining the "noise power spectrum" co y (f> by 


we see that 


C0y(f) = 4 J 0 °° v|/ y (x) cos(27ifx) dx 
V|/y(x) = Jo- co y (f) cos(27ifx) df 


(1.3) , 

(1.4) . 


Taking into account Eq.(1.3) one can show that [4] 

< y 2 > = J 0 °° co y (f)df and, consequently, that < Sy f 2 > = co y (f) df. (1.5), 

2 2 

where 8yf gives the y “ fluctuations due to frequencies that are in the 
interval between f and f+df. 

Equations (1.3) and (1.4) together comprise what is known as the 
Wiener-Khintchine Theorem 1141 which is of prime importance in the 
analysis of noise problems. In Figure 2 [4] are shown sketches of two 
different stochastic noises y(t) and the respective functions co y (f) and \|/ y (f). 
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Figure 2. Sketches of noise, autocorrelation function v|/ y (f) and power spectrum co y (f) 
for two types (a and b ) of statistically stationary fluctuations. 

Defining F y (x) = j 0 t+T y(t) dt 

we can show that [4] 

< F y 2 (t)> - (1/2tt 2 ) jo” [co y (f)/f 2 ]{l- cos(27tfx)}df 

and that 

d< Fy 2 (x)>/ox = (1 /tt) jo” [cOy(f)/f] sin(27ifx)] df 
and hence by inversion, 

co y (f) = 47if j 0 ” 8< Fy 2 (x)>/ox sin(27ifx) dx (1.9). 

In the sequence the above approach is used to analyze many 
stochastic phenomena . In Section 1, the Brownian motion. In Section 2, 
the electric RL circuit. In Section 3, the electric RC circuit. In Section 4, 
the two resistors Johnson-Nyquist electric circuit. In Section 5, complex 
electrical circuits with impedance Z(f). In Section 6, a circuit with R and a 
frequency amplifier. In Appendix A is shown the estimation of < v (x) > 
and < x"(x) > for Brownian motion and, finally, in Appendix B is 
commented how these phenomena can be interpreted taking into account 
the Fluctuation-Dissipation Theorem. 


( 1 . 6 ) 

(1.7) 

( 1 . 8 ) , 
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(1) Brownian motion. 

As well known, the motion of a "Brownian particle" with mass M is 
governed by the Langevin's equation [4,5] 

Mdv/dt = - Bv(t) + F(t) (1.1), 

where B is the dissipative parameter and F(t) the stochastic force. This 
equation can be also written as 

dv/dt + v/xi = A(t) (1.2), 

where is the relaxation time given by ii = M/B and A(t) = F(t)/M . 

Average velocity fluctuations < v 2 (t) >. 

Solving Langevin's equation (1.1) we have v(t) given by [4] 

v(t) = v 0 e 4/Tl + e' t/Tl J 0 l e ll/Tl A(u) du (1.3). 

Following again MacDonald [4] one see that Eq.(1.2) is given by 

\|/ v (t) =<v(t)v(t + t)>= <v g 2 > e' (2t+T)/Tl + e' (2t+x)/Tl jc/jo 1 ^ e (u+co) <A(u)A(ro)> du da> 

= <v 0 2 > e ' (2t+T)/xl + (kT/M) e“ x/T 1 (1 - e' 2tM ) (1.4). 

Note that the time t corresponds to the observation time in the 
ensemble. As \|/ v (x), defined by (1.2), which is evaluated for an equilibrium 
ensemble, we can assume that < v 0 2 > = kT/M. Thus, for a sufficiently long 
time-average t—>oo we have 


\|/ v (x) = (kT/M) e'™ (1.5). 

So, according to WKT, co v (f) defined by (1.3) is given by [4] 

co v (f) = (4kT/M) J 0 - e' T/Tl cos(27ifx) dx , 

that is, 

to v (f) = (4kTxi/M) (l/[l+(27ifxi) 2 ]} (1.6), 

showing clearly how the velocity fluctuations Svf of the particle would be 
distributed in frequencies f. As M —> 0 , that is, T\ —> 0 the "power" 
spectrum of the velocity fluctuations becomes uniform, that is, 
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co v (f) ~ 4kTB 


(1.7), 


which corresponds to the "perfect random motion". 

According to Eqs.(1.6) and (1.6) it can be verified that [4] 

< 5v f 2 > = to v (f) df = (4kTB) {l/[l+(27rfx 1 ) 2 ]}df (1.8). 

For time intervals x » Xi, that is, for frequencies fxi «1, Eq.(1.8) gives, 

< 8v f 2 > ~ 4kBT df (1.9). 

The total average squared velocity fluctuations < v 2 >, that is, due to 
all frequencies f, is given by 

< v 2 > = Jo” < 5v f 2 > df = J> co v (f) df 

= 4kTB j o 0O df/[l+(27ifx 1 ) 2 ] 

= 4KT(xi/M)[l/4xi] = kT/M (1.10). 

which is the equilibrium average squared velocity, according to the 
("equilibrium") Maxwell-Boltzmann statistical mechanics. If we have a 
measuring instrument with a limiting response time x « Xi, then the 
observed fluctuations would be 

< v 2 > ~ 4kTB j 0 1/T df/[l+ (27rfx!) 2 ] ~ (4kT/M)(x 1 /x) (1.11). 

2 1/2 

In other words, the observed Brownian Movement velocity (~ <v“> ) 
would be reduced roughly by ratio (xi/x) as compared with value 
[~(kT/M) 1/2 ], predicted by the "equilibrium" statistical mechanics. [4,5] 

Average displacement fluctuations < x 2 (t) >. 

If y(t) = v(t) we verify from Eq.(1.6) that F v (x) is the mean square 
displacement x(t) of the particle in interval x , that is, < x“(x) >. So, from 
Eq.(1.7) we have, 

< x 2 (x) > = (1/27T 2 ) Jo- [co v (f)/f 2 ]{ 1- COS(27lfx)}df 

= 2kTBx - (2kTxf/M) (1 - e' T/xl ) (1.12), 

For long time intervals of observation x « T\ we verify that 
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< x 2 (x) > -> 2kTBx = 2Dx 


(1.13), 


where D = kTB is the diffusion coefficient, which is the familiar Einstein 
equation characteristic of the random Brownian movement. [4 ‘ 5] On the 
other hand for x < Xi we obtain 

< x 2 (x) > ~ v 0 2 x 2 , where v 0 =(kT/M) 1/2 (1.14), 

which describes the motion of a free molecule . [4,5] 

Thus, for observation times x comparable with the relaxation time Xi 
we have two different results for particle displacements (see Appendix A). 


(2) Electrical Circuit RL. 

The RL circuit obeys the LangevhTs equation Ldl/dt + RI = E(t), 
that is, [4 ’ 5] 


dl/dt + I/x 2 = A(t), (2.1), 

where E(t) is a fluctuating voltage, A(t) = E(t)/L and x 2 = L/R a relaxation 
time, characteristic of the RL circuit. 

The charge current I(t) obeys an equation (2.1) that is formally 
equivalent to Eq.(1.2). In this case we have, instead of Eq.(1.5), 

\|/i(x) = (kT/L) e' T/T2 , where is taken into account an average over an 
equilibrium ensemble of RL systems. Thus, following the same procedure 
adopted in Section 1 we verify that the "current noise" in the frequency 
interval df is given by 

< 5I f 2 > RL = (4kT/R)df/[l+ (27ifx 2 ) 2 ] (2.2). 

So, the current noise in the RL circuit < I 2 > RL would be given by 

< I 2 >rl= \j J < 5i f 2 > df = (4kTx 2 /L) J 0 °° df/[l+ (2jifx 2 ) 2 ] = (4kTx 2 /L)[l/4x 2 ] 
that is, 

< I 2 > RL = kT/L (2.3). 
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(3) Electrical Circuit RC. 

The RC circuit obeys the LangevhTs equation C dV/dt + V/R = E(t), 
that is, [6] 

dV/dt + V/x 3 = F(t), (3.1), 

where E(t) is a fluctuating voltage, F(t) = E(t)/C and x 3 = RC the relaxation 
time characteristic of the RC circuit. Following the same procedure used in 
Section 1 and 2 we see that \|/ v (t) = (kT/C) e' T/l3 and that 

< SV 2 > rc = (4kTx 3 /C)df/[l+ (27ifx 3 ) 2 ] (3.2), 

which is the voltage noise in the frequency interval df. 

Thus, the voltage noise in RC circuit < V 2 > RC would be given by 

< v 2 > RC = J> < 5Vf 2 > df = (4kTx 3 /C) J> df/[l+ (27ifx 2 ) 2 ] = (4kTx 3 /C)[l/4x 3 ] 
That is, 

< V 2 > RC = kT/C (3.3). 

Note that, according to the Equipartition Theorem of Energy 

(ETE) we must have 

C< V 2 >/2 = L < I 2 >/2 = kT/2, that is, 

< I 2 >rl = kT/L and < V 2 > RC = kT/C (3.4). 

Eqs.(3.4) are used by many authors to estimate voltage and current noises 
in RL and RC circuits, [6 ' 9] respectively. 


(4) Two resistors Johnson-Nyquist Circuit. 

In his original paper, [6] Nyquist analyzed a circuit formed only by two 
ideal resistors in parallel, with resistance R each one, at a temperature T, 
connected by a long non-dissipative transmission line. He has shown that 
the resistance R generates a voltage noise < V 2 > R , given by 

< V 2 > R = 4kTR (4.1), 


and a current noise 


< I 2 > R = < V 2 > R /R 2 = 4kT/R (4.2). 

Nyquist"s formula [6] is essentially the same as that derived by Planck 
in 1901 for the electromagnetic radiation of a black body in one dimension 
- i.e., it is the one-dimension version of the Planck's law of blackbody 
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radiation. [8] In other words, a hot resistor will create electromagnetic waves 
on a transmission line just like a hot object in free space. These waves, that 
create the electric current in the circuit, are generated by the thermal 
energy stored in a body at temperature T obeying by Planck distribution. 
Indicating by hf df the electric power, with frequencies in the interval f 
and f + df, transferred to the circuit by each one of the resistors it would be 
given by 

hfdf = (I circull ) 2 Rdf = [(5V f 2 ) r /4R 2 ]R (4.3), 

where (SV f ) R is the resistance noise voltage in the interval f and f + df. In 
this way we see that 

(SV f 2 ) R = 4R hf df (4.4). 

Taking into account Planck's law the "voltage noise" < V 2 > R , that 
is, due to all degrees of freedom f given by 

< V 2 > R = Jo” (5V f 2 ) R P(f) df = 4R j 0 °° hfdf /(e hf/kT -1) = 4RkT, 

according to Eq.(4.1). For high temperatures, that is, kT » hf we see 
that 

(SVf 2 ) R ~ 4RkT df (4.5), 

that is, the "voltage noise" (SVf) R does not depend of the frequency f. It is 
known as a "white noise". 


(5) Complex Electrical Circuits with Impedance Z(f). 

Nyquist's original paper [6] also provided the generalized noise for 
components having partly reactive response, e.g., sources that contain 
capacitors or inductors. Such component can be described by a frequency- 
dependent impedance Z(f). He has shown that, over a span of frequencies fi 
and f 2 the voltage noise < V 2 > will be given by [4,7] 

< V 2 > = J fl « S v (f) df where S v (f) = 4kT q(f) Re[Z(f)] (5.1), 
and r|(f) = (hf/kT) /(e hf/kT -l). 

In what follows it will be analyzed only circuits at high temperatures, 
that is, when kT » hf and in which electric currents are generated by an 
external voltage. Thus, putting q(f) ~ 1 in Eq.(5.1) we have 


(SV f 2 x = 4kT Re[Z(f)]. 


(5.2). 
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Alternatively, the noise current < I 2 > could be obtained by [ ,7_1 ] 


Si(f) = 4kT Re[Y(f)], where the admittance Y(f) = 1/Z(f), 
that is, 

(SI f 2 ) z = Si(f) df and < I 2 > z = 4kT jf, c Re[Y(f)] df (5.3). 


(5.1)Circuit RC. 

Since, for the RC circuit, 1/Z = 1/R + i27ifC, that is, 

Re[Z] = \Z\ = R/(\+ 4ti¥c 2 R 2 ) 1/2 we obtain, 

(SVf 2 ) RC = 4kTR/(l + 47t 2 f 2 C 2 R 2 ) 1/2 (5.4). 


According to Eq.(5.1) we must have 
< V 2 > RC = 4kT f 0 °° Re[Z(f)] df = 4kTR jo * df/(l + 47i 2 f 2 C 2 R 2 ) 

= (4kTR/a) j 0 ” dx/( 1 + x 2 ) 1/2 , where a = 27xRC. 

In this way we obtain, in agreement with Eq.(3.4): 

< V 2 >Rc = kT/C, 

So, 


1/2 


< I 2 > RC = < V 2 > rc /R 2 = (kT/R 2 C) 


(5.5). 


(5.2)Circuit RL. 

In this case Z(f) = R + i2jrf L, that is, Re[Z(f)] = [R 2 + 4 ti¥l 2 ] 1/2 . 
So, we obtain using Eq.(4.8), where x 2 = L/R: 

(5V f 2 ) RL = 4kT Re[l/Z(f)] df = 4kTR df /(I + 4¥fx 2 2 ) 1/2 (5.6), 

where x 2 = L/R. 

When L/R « 1, that is, fx 2 « 1, Eq.(5.6) becomes written as 

(8V f 2 V= 4kTRdf (5.7), 

showing that when the resistive effects are much larger than the inductive 
ones we see that 

(8V, 2 ) R L=(5V ( 2 ) R K4kTRdf and (SI, 2 ) RL = (5V, 2 ) R = (4kT/R) df (5.8), 

that is, the noise effects are essentially the resistive ones. 

The total RL noises are given by 

< I 2 > RL = 4kT j 0 c0 Re[l/Z(f)] df = 4kT jo” df /(R 2 + 4 ti¥l 2 ) 1/2 (5.9), 
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(5.10), 


that is, <I 2 >rl= kT/L 

in agreement with Eq.(2.3). Consequently, 

< V 2 > RL = < I 2 > RL R 2 = kTR 2 /L. (5.11). 

Finally, let us note that for the RC circuit we have 

< V 2 > RC = kT/C and < I 2 > RC = < V 2 > rc /R 2 = (kT/R 2 C), 
and for the RL circuit, 

< V 2 >RL = kT/L and < I 2 > RL = < V 2 > rl /R 2 = (kT/R 2 L). 
From these equations result: 

< V 2 > RC / < V 2 > RL = L/C and < I 2 > RC /< I 2 ^ = L/C . 

(6) Circuit with R and a Frequency Amplifier. [4] 

Let us consider a circuit (see Figure 3) with R in parallel with an 
amplifier network A(f) with a very high input impedance (IZI » R). 







- ? 
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Figure 3. Sketch 141 to the illustrate amplification of electrical noise generated by a 
resistor R. 

Assuming that the amplifier itself introduces a negligible "noise" in 
comparison with that of passive resistor R at the input terminals, then the 
over-all noise at the output will be estimated by [4] 

< 8V 2 (t) > A = 4RkT IA(t,f)l 2 df (6.1), 

where A(t,f) is the complex voltage gain of the amplifier as a function of 
t and frequency f. So, the " noises" < V 2 (t) > A and < SI 2 (t) > A , at the time t, 
due to the contribution of all frequencies, are given by 

< X 2 (t) > A - f" IA(t,f)l 2 df (6.2) 

If the amplifier unit has a gain concentrated around a frequency f 0 like 
|A(f)|= 8(f-f 0 ) the "noises" would be: 

< V 2 (t) > A = 4RkT IA(t,f 0 )l 2 and < I 2 (t) > A = (4kT/R) IA(t,f 0 )l 2 (6.3). 
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APPENDIX A. Estimation of < y 2 (t) > and < x 2 (t) >. 

According to Eq.(13) we have [4] 

v(t) = Vo e‘ T/Tl + e' T/Tl j 0 T e u/Tl A(u) du (A. 1). 

Integrating Eq.(A.l) we obtain x(x) and taking into account "reasonable 
molecular chaos approximations" one can see that [4] 

< x 2 (t) > = <v 0 2 > x! 2 ( 1 — 2e' T/xl +2e~ 2t/t1 ) + (kTxi 2 /M)(-l+4e' xxl - e - 2t/xl ) + 2BkTx (A.l). 

For t » Ti we obtain, if <v 0 2 > = kT/M, since the average is performed over 
the equilibrium ensemble, 

< x 2 (t) > ~ <v 0 2 > T! 2 - (kT/M)xi 2 + 2BkTx ~ 2Dx (A.3) 

that describes the molecular motion in a viscous medium according to 
Einstein. [4] On the other hand for x<xj we get 

< x 2 (x) > ~ v 0 2 x 2 , where v Q = (kT/M) 1/2 (A.3), 

which gives the motion of a free molecule. 

These results show that for observation times x comparable with the 
relaxation time xi of the system we have two different results for the 
particles displacement. This shows why fluctuation theory (or "correlation 
function approach") might be called "time-dependent statistical" 
mechanics. 

From (A.l) we can see that ensemble average 

< v 2 (t) > = <v„ 2 > e 2,M + 2 e' 2t/rl J 0 V M <v 0 A(u) > du 

+ e' 2l/rl k f 1 e (u+<0)/rl <A(u)A(co)> du doo (A.4). 

The second term of Eq.(A. 1) vanishes for large values of x. However, the 
third term does not vanish because, when co ~ u there is a definite 
contribution to the double integral. Eq.(A.l) is well estimated by [4] 

< v 2 (x) > = <v 0 2 > e‘ 2T/Tl + (kT/M) (1 - e' 2xM ) (A.5), 

where, as seen above, < v 0 2 > = KT/M. 

From Eq.(A.5), for x » xi we verify that 
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< v 2 (x) > ~ kT/M = < Vo 2 > , 

the average value obtained by the equilibrium Boltzmann statistics. On the 
other extreme, that is, for measuring instrument with limiting response time 
x « Ti, then the observed velocity fluctuations would be given by 

< v 2 (x) > ~ (4kT/M)(T!/T) (A.6). 

2 1/9 

In other words, the observed Brownian Movement velocity (~ <v 0 "> ) 

1 /9 

would be reduced roughly by the ratio (ii/x) as compared with value 
[~(kT/M) 1/2 ], predicted directly by the "equilibrium" statistical mechanics. 


APPENDIX B. The Fluctuation-Dissipation Theorem. 

The Fluctuation-Dissipation Theorem(FDT) [11] was proven by H. 
Callen and T. Welton [12] and expanded by R. Kubo. [11J There are [11] 
antecedents to the general theorem, including A. Einstein explanations of 
the Brownian Motion and by H. Nyquist of the Resistance-Johnson noise. 

The FDT is a powerful tool in statistical physics for predicting the 
behavior of systems that obey the detailed balance. [13] It is a general proof 
that thermodynamic fluctuations in a physical variable predict the response 
quantified by the admittance or impedance of the same physical variable 
(like voltage, temperature difference, etc.) and vice-versa. The FDT applies 
both to classical systems and quantum mechanical fluctuations. [14] 

In few words, the FDT says that when there is process that dissipates 
energy, turning into heat (e.g., friction), there is a reverse process related to 
thermal fluctuations. The FDT is a general result of statistical 
thermodynamics that quantifies the relation between the fluctuations in a 
system that obeys the detailed balance and the response of the system to 
applied perturbations. This is can be best understood by considering some 
examples: [11] 
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■ Drag and Bro wnian motion 


If an object is moving through a fluid, it experiences drag (air resistance or fluid resistance). Drag dissipates 
kinetic energy, turning it into heat. The corresponding fluctuation is Brownian motion. An object in a fluid 
does not sit still, but rather moves around with a small and rapidly-changing velocity, as molecules in the fluid 
bump into it. Brownian motion converts heat energy into kinetic energy—the reverse of drag. 

• Resistance and John son noise 

If electric current is running through a wire loop with a resistor in it, the current will rapidly go to zero because 
of the resistance. Resistance dissipates electrical energy, turning it into heat (Joule heating ). The 
corresponding fluctuation is Johnson noise . A wire loop with a resistor in it does not actually have zero 
current, it has a small and rapidly-fluctuating current caused by the thermal fluctuations of the electrons and 
atoms in the resistor. Johnson noise converts heat energy into electrical energy—the reverse of resistance. 

* LiWrf ab sorpti on and therma[rad[aSon 

When light impinges on an object, some fraction of the light is absorbed, making the object hotter. In this 
way, light absorption turns light energy into heat. The corresponding fluctuation is thermal radiation (e.g., the 
glow of a "red hot" object). Thermal radiation turns heat energy into light energy—the reverse of light 
absorption. Indeed, Kir chhoff s la w of th ermal radiation confirms that the more effectively an object absorbs 
light, the more thermal radiation it emits. 
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